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^J , Abstract 

Y^ • It was noticed by Harel in |Har86) that "one can define Incomplete 

versions of the well-known Post Correspondence Problem" . We first 
give a complete proof of this result, showing that the infinite Post 
Correspondence Problem in a regular w-language is S} -complete, hence 
located beyond the arithmetical hierarchy and highly undecidable. We 
qq | infer from this result that it is IlJ-complctc to determine whether two 

00 ■ given infinitary rational relations are disjoint. Then we prove that there 

^O | is an amazing gap between two decision problems about w-rational 

[ — ■ functions realized by finite state Biichi transducers. Indeed Prieur 

^^ | proved in |Pri01[ IPri02] that it is decidable whether a given w-rational 

function is continuous, while we show here that it is Sj-complete to 
determine whether a given w-rational function has at least one point of 
continuity. Next we prove that it is II} -complete to determine whether 
the continuity set of a given w-rational function is w-regular. This 
gives the exact complexity of two problems which were shown to be 



> 



X 



03 ■ undecidable in (CFS08 . 



Keywords. Decision problems; infinite Post Correspondence Problem; an- 
alytical hierarchy; high undecidability; infinitary rational relations; omega 
rational functions; topology; points of continuity. 

1 Introduction 

Many classical decision problems arise naturally in the fields of Formal Lan- 
guage Theory and of Automata Theory. It is well known that most prob- 
lems about regular languages accepted by finite automata are decidable. 



On the other hand, at the second level of the Chomsky Hierarchy, most 
problems about context-free languages accepted by pushdown automata or 
generated by context-free grammars are undecidable. For instance it fol- 
lows from the undecidability of the Post Correspondence Problem that the 
universality problem, the inclusion and the equivalence problems for context- 
free languages are also undecidable. Notice that some few problems about 
context-free languages remain decidable like the following ones: "Is a given 
context-free language L empty ?" "Is a given context-free language L infi- 
nite ?" "Does a given word x belong to a given context-free language L ?" 
Senizergues proved in (SenOlj that the difficult problem of the equivalence 
of two deterministic pushdown automata is decidable. Notice that almost 
proofs of undecidability results about context-free languages rely on the un- 
decidability of the Post Correspondence Problem which is complete for the 
class of recursively enumerable problems, i.e. complete at the first level of 
the arithmetical hierarchy. Thus undecidability proofs about context-free 
languages provided only hardness results for the first level of the arithmeti- 
cal hierarchy. 

On the other hand, some decision problems are known to be located be- 
yond the arithmetical hierarchy, in some classes of the analytical hierarchy, 
and are then usually called "highly undecidable". Harel proved in [Har86 
that many domino or tiling problems are £}-complete or Il}-complete. For 
instance the "recurring domino problem" is Sj-complete. It is also In- 
complete to determine whether a given Turing machine, when started on a 
blank tape, admits an infinite computation that reenters infinitely often in 
the initial state. Alur and Dill used this latter result in |AD94| to prove that 
the universality problem fot timed Biichi automata is n}-hard. In [CC89], 
Castro and Cucker studied many decision problems for w-languages of Tur- 
ing machines. In particular, they proved that the non-emptiness and the 
infiniteness problems for w-languages of Turing machines are Sj-complete, 
and that the universality problem, the inclusion problem, and the equiva- 
lence problem are Il^-complete. Thus these problems are located at the first 
or the second level of the analytical hierarchy. Using Castro and Cucker's 
results, some reductions of [Fin06at IFin06bj . and topological arguments, 
we have proved in |Fin09j that many decision problems about 1-counter uj- 
languages, context free w-languages, or infinitary rational relations, like the 
universality problem, the inclusion problem, the equivalence problem, the 
determinizability problem, the complementability problem, and the unam- 
biguity problem are Il^-complete. Notice that the exact complexity of nu- 
merous problems remains still unknown. For instance the exact complexities 
of the universality problem, the determinizability, or the complementabil- 
ity problem for timed Biichi automata which are known to be nj-hard, see 
[AD94l[Frnn6c] . 



We intend to introduce here a new method for proving high undecidability 
results which seems to be unexplored. It was actually noticed by Harel in 
|Har86] that "one can define Ej-complete versions of the well-known Post 
Correspondence Problem", but it seems that this possibility has not been 
later investigated. We first give a complete proof of this result, showing 
that the infinite Post Correspondence Problem in a regular w-language is 
Ej-complete, hence located beyond the arithmetical hierarchy and highly 
undecidable. We infer from this result a new high undecidability result, 
proving that it is H^-complete to determine whether two given infinitary 
rational relations are disjoint. Then we apply this Sj-complete version of 
the Post Correspondence Problem to the study of continuity problems for 
w-rational functions realized by finite state Biichi transducers, considered 
by Prieur in [PriOH lPri02j and by Carton, Finkel and Simonnet in [UFS08J. 
We prove that there is an amazing gap between two decision problems about 
w-rational functions. Indeed Prieur proved in [PriOH lPri02| that it is decid- 
able whether a given w-rational function is continuous, while we show here 
that it is X}-complete to determine whether a given w-rational function has 
at least one point of continuity. Next we prove that it is nj-complete to 
determine whether the continuity set of a given u;-rational function is ir- 
regular. This gives the exact complexity of two problems which were shown 
to be undecidable in [CFS08J. 

The paper is organized as follows. We recall basic notions on automata 
and on the analytical hierarchy in Section 2. We state in Section 3 the 
Ej-completeness of the infinite Post Correspondence Problem in a regular 
w-language. We prove our main new results in Section 4. Some concluding 
remarks are given in Section 5. 

2 Recall of basic notions 



We assume now the reader to be familiar with the theory of formal (u)- 

languages |Tho9CH ISta97j . We recall some usual notations of formal language 

theory. 

When Z is a finite alphabet, a non-empty finite word over Y is any sequence 

x = a\ . . . Ofc, where aj & T. for i = 1, . . . , k , and k is an integer > 1. Y* is 

the set of finite words (including the empty word) over Y. 

The first infinite ordinal is uj. An uj-word over Y is an u -sequence a\ . . . a n . . ., 

where for all integers i > 1, a, £ Y. When a is an w-word over Y, 

we write a = a(l)a(2) . . . a(n) . . ., where for all i, a(i) € Y, and a[n] = 

a(l)a{2)...a{n). 

The usual concatenation product of two finite words u and v is denoted u ■ v 

and sometimes just uv . This product is extended to the product of a finite 



word u and an a;- word v. the infinite word u ■ v is then the w-word such 
that: (u ■ v)(k) = u(k) if k < \u\ , and {u ■ v){k) = v(k — \u\) if k > |u|. 
The set of ui- words over the alphabet Y. is denoted by Y. w . An oj-language 
over an alphabet Z is a subset of Y. u . 

Definition 2.1 A Biichi automaton is a 5-tuple A = (K,T.,5,qo,F), where 
K is a finite set of states, Y. is a finite input alphabet, qo € K is the initial 
state and 5 is a mapping from K x[ into 2 . The Biichi automaton A is 
said to be deterministic iff: 5 : K x Y. — > K. 

Let a = a\ai . . . a n . . . be an co-word over Y.. A sequence of states r = 
Q1Q2 ■ ■ ■ Qn ■ ■ ■ is called an (infinite) run of A on a, starting in state p, iff: 
1) Qi = P an d ®) f or each i > 1, qi + \ G 5(qi,ai). In case a run r of A on 
a starts in state qo, we call it simply "a run of A on a ". For every run 
r = Q1Q2 ■ ■ ■ Qn ■ ■ ■ of A, In(r) is the set of states in K entered by A infinitely 
many times during run r. The uj-language accepted by A is: 

L(A) = {ff£ Y^ J there exists a run r of A on a such that In(r)P\F 7^ 0}. 

An uj-language L C T. u is said to be regular iff it is accpted by some Biichi 
automaton A. 

We recall that the class of regular w-languages is the w-Kleene closure of 
the class of regular finitary languages, see |Tho9CH ISta97| : an w-language 
L C I w is regular iff it is of the form L = Ui<i<n ^* ' ^t '■> f° r some regular 
finitary languages Ui,Vi C Y.*. Acceptance of infinite words by other finite 
machines like pushdown automata, Turing machines, Petri nets, . . . , with 
various acceptance conditions, has also been considered. In particular, the 
class of context-free w-languages is the class of w-languages accepted by 
Biichi pushdown automata, see |Tho90l ISta97l IKH93] . 

The set of natural numbers is denoted by N, and the set of functions from 
N into N is denoted by T . We assume the reader to be familiar with the 
arithmetical hierarchy on subsets of N. We now recall the definition of classes 
of the analytical hierarchy which may be found in Rog67[ IOdi89|, IOdi99| . 



Definition 2.2 Let k,l > be some integers. & is a partial computable 
functional ofk function variables and I number variables if there exists z G N 
such that for any (/1, . . . , /&, x\, . . . , x{) € T k x N l , we have 

$(/i, ■ ■ ■ ,fk,Xl, ■ ■ ■ ,xi) = t/ 1 '-'^!, . . .,xi), 

where the right hand side is the output of the Turing machine with index z 
and oracles fi, ■ ■ ■ , fk over the input (xi, . . . , x{). For k > and 1 = 0,$ is 
a partial computable functional if, for some z, 

$(/i,...,/ fc )=r/ 1 -- f H0)- 



The value z is called the Godel number or index for <£. 

Definition 2.3 Let k,l > be some integers and R C T k xN l . The relation 
R is said to be a computable relation of k function variables and I number 
variables if its characteristic function is computable. 

We now define analytical subsets of N . 

Definition 2.4 A subset R ofN 1 is analytical if it is computable or if there 
exists a computable set S C T rn x W l , with m > and n > I, such that 

R= {(x 1 ,...,Xi) | (QlSi)(Q 2 S 2 ) ■ ■ ■ (Qm+n-lS m+ n-l)S(fl, . . . , f m ,Xl, . . . ,X n )}, 

where Qi is either V or 3 for \<i<m + n — I, and where s±, . . . , s m + n _; 
are /i, ... , f m , x t+1 , ... ,x n in some order. 

The expression (Qis 1 )(Q 2 s 2 ) ■ ■ ■ {Qm+n-ls m +n-l)S{fi, ■ ■ ■ ,f m ,xi, ■ ■ ■ ,x n ) is 
called a predicate form for R. A quantifier applying over a function variable 
is of type 1, otherwise it is of type 0. In a predicate form the (possibly empty) 
sequence of quantifiers, indexed by their type, is called the prefix of the form. 
The reduced prefix is the sequence of quantifiers obtained by suppressing the 
quantifiers of type from the prefix. 

We can now distinguish the levels of the analytical hierarchy by considering 
the number of alternations in the reduced prefix. 

Definition 2.5 For n > 0, a T^-prefix is one whose reduced prefix begins 

with 3 1 and has n — 1 alternations of quantifiers. A T^-prefix is one whose 

reduced prefix is empty. For n > 0, a IL^-prefix is one whose reduced prefix 

begins with V 1 and has n — 1 alternations of quantifiers. A IlQ-prefix is one 

whose reduced prefix is empty. 

A predicate form is a S^ (Tl^J-form if it has a S^ (Tl^) -prefix. The class of 

sets in some N l which can be expressed in Yi\-form (respectively, Ti^-form) 

is denoted by S^ (respectively, ![„)■ 

The class Sq = I1q is the class of arithmetical sets. 

We now recall some well known results about the analytical hierarchy. 

Proposition 2.6 Let SCfJ 1 for some integer I. Then R is an analytical 
set iff there is some integer n > such that ReSJ, or R 6 11^. 

Theorem 2.7 For each integer n > 1, 

(a) siunlcEi +1 nni + , 

(b) A set i?CN is in the class E^ iff its complement is in the class 11^ . 

(c) ££- n£^0 and ni-E^0. 



Transformations of prefixes are often used, following the rules given by the 
next theorem. 

Theorem 2.8 For any predicate form with the given prefix, an equivalent 
predicate form with the new one can be obtained, following the allowed prefix 
transformations given below : 

(a) 
(b) 

(c) 

(d) 



..3°3°. 


. ->■ . 


. . 3° . . . 


..V°V°. 


. -t . 


..V°... 


..3 1 3 1 . 


. ->■ . 


..3 1 ... 


..w. 


. ->■ . 


..V 1 ... 


..3° . 


. — >• . 


..3 1 ... 


..V° . 


. — >• . 


..V 1 ... 


. . 30V 1 . 


. ->■ . 


..V^ . 


..V^ 1 . 


. ->■ . 


. . 3^° . 



We now recall the notions of 1-reduction and of S^-completeness (respec- 
tively, n* -completeness). Given two sets 4,5CNwe say A is 1-reducible 
to B and write A <\ B if there exists a total computable injective function 
/ from N to N with A = f~ l [B\. A set A C N is said to be £* -complete 
(respectively, Il^-complete) iff A is a S^-set (respectively, Il^-set) and for 
each E^-set (respectively, Il^-set) B C N it holds that B <i A. 

We now recall an example of a S^-complete decision problem which will be 
useful in the sequel. 

Definition 2.9 A non deterministic Turing machine M. is a 5-tuple A4 = 
(Q, T., T, 5, qo), where Q is a finite set of states, Y. is a finite input alphabet, 
r is a finite tape alphabet satisfying ICT and containing a special blank 
symbol □ € V \ E, qo is the initial state, and 5 is a mapping from Q x V to 
subsets of Q x V x {L,R,S}. 

Harel proved the following result in |Har86] . 

Theorem 2.10 The following problem is Y\-complete: Given a Turing ma- 
chine A4 Z , of index zEN, does Ai z , when started on a blank tape, admit 
an infinite computation that reenters infinitely often in the initial state qo ? 



3 The infinite Post Correspondence Problem 

Recall first the well known result about the undecidability of the Post Cor- 
respondence Problem, denoted PCP. 



Theorem 3.1 (Post, see [HMU01]) Let V be an alphabet having at least 
two elements. Then it is undecidable to determine, for arbitrary n-tuples 
(xi, X2 • • • , x n ) and (2/1,2/2 • • • , Un) of non-empty words in V* , whether there 
exists a non-empty sequence of indices i\, %i . . . , i& such that x^x^ ■ ■ .x% k = 

y%\ v%2 • • • Vik ■ 

On the other hand, the infinite Post Correspondence Problem, also called 
cj-PCP, has been shown to be undecidable by Ruohonen in |Ruo85| and by 
Gire in |Gir86| . 

Theorem 3.2 Let V be an alphabet having at least two elements. Then it is 
undecidable to determine, for arbitrary n-tuples (x\, . . . , x n ) and (yi, . . . , y n ) 
of non-empty words in V* , whether there exists an infinite sequence of indices 
h,k,- ■ ■ ,ik ••• such that x h x i2 ...x ik ... = y^y^ ...y ik ... 

Notice that an instance of the uj-PCP is given by two n-tuples {x%, . . . ,x n ) 
and (yi, . . . , y n ) of non-empty words in l~*, and if there exist some solutions, 
these ones are infinite words over the alphabet {1, . . . , n}. 

We are going to consider now a variant of the infinite Post Correspondence 
Problem where we restrict solutions to w-words belonging to a given ir- 
regular language L(A) accepted by a given Biichi automaton A. 

An instance of the w-PCP in a regular u;-language, also denoted u;-PCP(Reg), 
is given by two n-tuples (xi, . . . , x n ) and (yi, . . . , y n ) of non-empty words 
in I - * along with a Biichi automaton A accepting words over {1, . . . , re}. A 
solution of this problem is an infinite sequence of indices i%, 12, ■ ■ ■ , ik ■ ■ ■ such 
that %xh ...ik--- G L(A) and x h x i2 ...x ik ...= y^y^ ...y ik .... 

Notice that one can associate in a recursive and injective way an unique 
integer z to each Biichi automaton A, this integer being called the index of 
the automaton A. We denote also A z the Biichi automaton of index z. Then 
each instance I = ((#1, . . . , x n ), (yi, . . . , y n ), A z ) can be also characterized 
by an index I 6 N. 

We can now state precisely the following result. 

Theorem 3.3 It is T,\-complete to determine, for a given instance I = 
((xi, . . . , x n ), (yi, . . . , y n ),A z ), given by its index I, whether there is an infi- 
nite sequence of indices ix,i2,---,ik--- such that i\%i . . .i\~. . . € L(A Z ) and 

X{ x Xi 2 . . . Xi k . . . = y%xVi2 ■ ■ ■ l/ik 

Proof. We first prove that this problem is in the class Sj. It is easy to 
see that there is an injective computable function $ : N — > N such that 
for all I G N the Biichi Turing machine M$<j\ of index $(/), where I = 



((xi, . . . , x n ), (yi, ... , y n ), .A*), accepts the set of infinite words ii*2 • • -ik ■ ■ ■ £ 
L(A Z ) such that x;^ . . . x ik . . . = y^y^ ...y ik .... Then the u;-PCP(Reg) 
of instance I = ((xi, . . . , x n ), (y±, . . . , y n ),-A z ) has a solution if and only if 
the w-language of the Biichi Turing machine M$ij\ is non-empty. Thus 
the w-PCP(Reg) is reduced to the non-emptiness problem of Biichi Turing 
machines which is known to be in the class £}. Indeed for a given Biichi 
Turing machine M z reading infinite words over an alphabet Y. we can ex- 
press L{jv[ z ) ^ by the formula "3x € Y u 3r [r is an accepting run of Ai z 
on x ]"; this is a S{-formula because the existential second order quantifica- 
tions are followed by an arithmetical formula, see [CC89, Fin09j for related 
results. Therefore the w-PCP(Reg) is also in the class £}. 

We now prove the completeness part of the theorem. Recall that the follow- 
ing problem (P) is S^-complete by Theorem 12.101 

(P): Given a Turing machine A4 Z , of index z S N, does Ai z , when started 
on a blank tape, admit an infinite computation that reenters infinitely often 
in the initial state go ? 

We can reduce this problem to the w-PCP in a regular w-language in the 
following way. 

Let M. = (Q,T.,V,S,qo) be a Turing machine, where Q is a finite set of 
states, Y. is a finite input alphabet, T is a finite tape alphabet satisfying 
[C f and containing a special blank symbol □ G r \ T., qo is the initial 
state, and 5 is a mapping from Q x V to subsets of Q x V x {L, R, S}. 

We are going to associate to this Turing machine an instance of the u- 
PCP(Reg). First we define the two following lists x = (xj)kj<„ and y = 
(yi)i<i< n of finite words over the alphabet lUTuQU {#}, where # is a 
symbol not in Y. U V U Q. 



X 


y 




# = xi 


#9o # = 2/1 


# 


# 




a 


a 


for each a £ V 


qa 


q'b 


if (q',b,S)£S(q, a) 


qa 


bq' 


iftf } b,R)€8(q,a) 


cqa 


q'cb 


ii(q',b,L) eS(q,a) 


q# 


bq'# 


if(q',b,R)e6(q,n) 


cq# 


q'cb# 


if (</,&, L)6 <*(?,□) 


q# 


q'b# 


ii(q J ,b,S)e8(q,D) 



The integer n is the number of words in the list x and also in the list 
y. We assume that these two lists are indexed so that x = (xi)i<i< n and 
V = (yi)i<i<n- Let now E C {1, 2, . . . , n} be the set of integers i such that 
the initial state go of the Turing machine M appears in the word y«. The u>- 
language L C {1, 2, . . . , n} u of infinite words over the alphabet {1, 2, . . . , n} 
which begin by the letter 1 and have infinitely many letters in E is a regular 
w-language and it is accepted by a (deterministic) Biichi automaton A. 
We now consider the instance I = ((»i, . . . , x n ), (j/i, . . . , y n ),A) of the lu- 
PCP(Reg). It is easy to check that this instance of the w-PCP(Reg) has a 
solution ii,i2,...,ik--- if and only if the Turing machine A4, when started 
on a blank tape, admits an infinite computation that reenters infinitely often 
in the initial state go- 

Thus the E^-complete problem (P) is reduced to the w-PCP in a regular 
cu-language and this latter problem is also E}-complete. □ 

4 Applications to infinitary rational relations 

4.1 Infinitary rational relations 

We now recall the definition of infinitary rational relations, via definition by 
Biichi transducers: 

Definition 4.1 A Biichi transducer is a sextuple T = (K,T.,V,A,qo,F), 
where K is a finite set of states, Y. and V are finite sets called the input and 
the output alphabets, A is a finite subset of K xP xT* x K called the set of 
transitions, qo is the initial state, and F C K is the set of accepting states. 
A computation C of the transducer T is an infinite sequence of consecutive 
transitions 

{qo,ui,vi,qi),{qi,U2,v 2 ,q2), ■ ■ ■ (%-i, «i,Vi, %)>(%>«*+!> v i+ i,q i+ i), .. . 

The computation is said to be successful iff there exists a final state qf € F 
and infinitely many integers i > such that qi = qj. The input word 
and output word of the computation are respectively u = u\.U2-u% . . . and 
v = v\.V2-Vz . . . The input and the output words may be finite or infinite. The 
infinitary rational relation R{T) C Z w x Y w accepted by the Biichi transducer 
T is the set of couples (u, v) € 5I W x l~ w such that u and v are the input and 
the output words of some successful computation C ofT ' . The set of infinitary 
rational relations will be denoted RAT2. 

If R{T) C Y. 00 x Y u is an infinitary rational relation recognized by the Biichi 
transducer T then we denote 

Dom{R(T)) = {m G I u I 3u £ r (u,v) € R{T)} 



and 

Im{R(T)) = {v G r | 3u G £"(«,«) G R(T)}. 

It is well known that, for each infinitary rational relation R{T) C Z w x T w , 
the sets Dom(R(T)) and Im(R(T)) are regular cj-languages and that one 
can construct, from the Biichi transducer T, some Biichi automata A and 
B accepting the w-languages Dom(R(T)) and Im(R(T)). 

To each Biichi transducer T can be associated in an injective and recursive 
way an index z G N and we shall denote in the sequel T z the Biichi transducer 
of index z. 

We proved in [Fin09] that many decision problems about infinitary rational 
relations are highly undecidable. In fact many of them, like the universality 
problem, the equivalence problem, the inclusion problem, the cofiniteness 
problem, the unambiguity problem, are IT^-complete, hence located at the 
second level of the analytical hierarchy. 

We can now use the £}-completeness of the w-PCP in a regular u;-language 
to obtain a new result of high undecidability. 

Theorem 4.2 It is U\-complete to determine whether two given infinitary 
rational relations are disjoint, i.e. the set {(z,z') G N 2 | R(T Z ) fl R(T Z ') = 0} 
is Il\-complete. 

Proof. We are going to show that the complement of this set is £}-complete, 
i.e. that the set {(z, z') G N 2 | R{T Z ) n R{%<) / 0} is Incomplete. 

Firstly, it is easy to see that, for two given Biichi transducers T z and T z ', 
one can define a Biichi Turing machine M.§( z ^ z i) of index &(z, z') accepting 
the w-language R(T Z ) fl R(T Z >). Moreover one can construct the function 
$ : N 2 — > N as an injective computable function. This shows that the set 
{(z, z') G N 2 | R(T z )nR(%>) + 0} is reduced to the set {z G N | L{M Z ) / 0} 
which is in the class T\, since the non-emptiness problem for ^-languages 
of Turing machines is in the class T,\. Thus the set {(z,z') G N 2 | R(T Z ) n 
R(Tz') 7^ 0} is in the class T,\. 

Secondly, we have to show the completeness part of the theorem. We are 
going to reduce the w-PCP in a regular w-language to the problem of the 
non-emptiness of the intersection of two infinitary rational relations. Let 
then / = ((xi, . . . ,x n ), (yi, . . . , y n ),A) be an instance of the o;-PCP(Reg), 
where the Xi and y, are words over an alphabet Y . We can then con- 
struct Biichi transducers T^m and T^ 2 m such that the infinitary ratio- 
nal relation i?(7w, 1 (n) C {1,2,... ,n} w x Y w is the set of pairs of infinite 
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words in the form (^2^3 ■ • • i x^x^x^ ■ ■ •) with 11^2*3 • • • G L(A). And sim- 
ilarly R(T^ 2 ij\) C {1,2,... ,n} w x T w is the set of pairs of infinite words 
in the form {i^iz • • • ; yi 1 yi 2 yi 3 ' ' ') with ii«2^3 • • • G L(A). Thus it holds 
that R-iT^tn) n i?(7l 2 m) is non-empty iff there is an infinite sequence 
hk ■ ■ ■ ik ■ ■ ■ G L(„4) such that x^x^ • • • x ik ■ ■ ■ = y^y^ •••yi h -- ■• The re- 
duction is now given by the injective computable function ^ : N — >■ N 2 given 
by*( Z ) = (* 1 ( 2 ),* 2 ^)). D 

4.2 Continuity of w-rational functions 

Recall that an infinitary rational relation R{T) C Z w x T w is said to be 
functional iff it is the graph of a function, i.e. iff 

[Vx G Dom(R{T)) 3ly G Im(R(T)) (x,y) G -R(T)]. 

Then the functional relation R(T) defines an w-rational (partial) function 
F r : Dom(R(T)) CIM T u by: for each u G Dom(R(T)), F T {u) is the 
unique u G l~ w such that (u,v) G R(T). 

Recall the following previous decidability result. 

Theorem 4.3 ( |Gir86] ) One can decide whether an infinitary rational re- 
lation recognized by a given Biichi transducer T is a functional infinitary 
rational relation. 

One can then associate in a recursive and injective way an index to each 
Biichi transducer T accepting a functional infinitary rational relation R(T). 
In the sequel we consider only these Biichi transducers and we shall denote 
T z the Biichi transducer of index z (such that R(T Z ) is functional). 

It is very natural to consider the notion of continuity for w-rational functions 
defined by Biichi transducers. 

We assume the reader to be familiar with basic notions of topology which 
may be found in |Kec95l ITho9CH ISta971 IPP04J . There is a natural metric 
on the set Y.^ of infinite words over a finite alphabet T. which is called 
the prefix metric and defined as follows. For u,v G 5Z W and m ^ d let 
d(u, v) = 2~ vref(u,v) w here l pre f(u,v) is the least integer n such that the 
(n + l) th letter of u is different from the (n + l) th letter of v. This metric 
induces on Y.^ the usual Cantor topology for which open subsets of Y w are 
in the form W ■ T u , where W C T*. 

We recall that a function / : Dom(f) C Y w — > P", whose domain is Dom(f), 
is said to be continuous at point x G Dom(f) if : 
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Vn > 1 3k > 1 Vy G Dom(f) [ d(x, y) < 2~ k => d(/(x), f{y)) < 2~ n ] 

The continuity set C(f) of the function / is the set of points of continuity of 
/. The function / is said to be continuous if it is continuous at every point 
x G Dom(f), i. e. if C{f) = Dom(f). 

Prieur proved the following decidability result. 

Theorem 4.4 (Prieur [Pri dl], |Pri02j ) One can decide whether a given 
uj -rational function is continuous. 

On the other hand the following undecidability result was proved in |CFS08j . 

Theorem 4.5 (see [CFS08] ) One cannot decide whether a given cv -rational 
function f has at least one point of continuity. 

We can now give the exact complexity of this undecidable problem. 

Theorem 4.6 It is T,\-complete to determine whether a given uj-rational 
function f has at least one point of continuity, i.e. whether the continuity 
set C(f) of f is non-empty. In other words the set {z£N C(Fj- z ) ^ 0} is 
Y,\-complete. 

We first prove the following lemma. 

Lemma 4.7 The set {z G N | C{Fj z ) ± 0} is in the class Y\. 

Proof. Let F be a function from Dom{F) C Y.^ into Y u . For some integers 
n, k > 1, we consider the set 

X k , n = {x£ Dom(F) | Vy G Dom(F) [ d(x, y) < 2~ k => d(F(x), F(y)) < T n }} 

For x G Dom(F) it holds that: 

x e C{F) -^^ Vn > 1 3k > 1 [ x G X k , n ] 

We shall denote Xk, n (z) the set X k , n corresponding to the function F-j- z 
defined by the Biichi transducer of index z. Then it holds that: 

X GC(F r J^Vn>l 3k >1 [ x G X k>n (z) ] 

And we denote Rk n (x,z) the relation given by: 

R k , n (x,z) <=^ [ X G X k ,n(z) ] 

We now prove that this relation is a rig-relation. 
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For x G T. u and k G N, we denote B(x, 2~ k ) the open ball of center x and of 
radius 2~ k , i.e. the set of y G S w such that d(x,y) < 2~ k . We know, from 
the definition of the distance d, that for two w-words x and y over S, the 
inequality d(x, y) < 2 simply means that x and y have the same (k + 1) 
first letters. Thus B(x, 2~ k ) = x[k + 1] • S^. But by definition of X k , n (z) it 
holds that: 

x G X kjTl (z) 

^^ (x G Dom{F Tz ) and F Tz [B(x, 2~ k ) n Dom(F T J] C B(F Tz (x), 2~ n )) 

We claim that there is an algorithm which, given x G Z w and z G N, can 
decide whether 

F Tz [B(x, 2- k ) n Dom(F Tz )} C w • T w , 

for some finite word w£T* such that \w\ = n + 1. 

Indeed the w-language B(x, 2" fc ) n Dom(Fj z ) = x[k + 1] • S w n Dom{Fj z ) is 
the intersection of two regular w-languages and one can construct a Biichi 
automaton accepting it. The graph of the restriction of the function F-f z 
to the set x[k + 1] • S w n Dom(Fj- z ) is also an infinitary rational relation 
and one can then also find a Biichi automaton B accepting Ff z [x[k + 1] • 
S w n Dom(F-r z )]. One can then find the set of prefixes of length re + 1 of 
infinite words in L(B). If there is only one such prefix w then Fj- z [B(x, 2 _fc )n 
Dom(Fj z )] C w ■ V w and otherwise we have Fj- z [B(x, 2~ k ) n Dom(Fj- z )\ ^ 
«/ • Y u for every word u/ G l~* such that |u/| = re + 1. We now write 
S(x,k,n, z) iff Fq- z \B(x,2~ k ) n Dom(Fj- z )] C u> • l~ w , for some finite word 
w£T* such that |u;| = re + 1. As we have just seen the relation S^x, k, re, z) 
is computable, i.e. a Aj relation. 

On the other hand, we have 

x G Xk tn (z) -<=> (x G Dom(Fq- z ) and S(x,k,n,z)) 

But Dom(Fj- z ) is a regular o;-language accepted by a Biichi automaton A 
which can be constructed effectively from T z and hence from the index z. 
And the relation (x G L(A)) is known to be an arithmetical II3 (and also a 
S3) relation, see |LT94| . Thus "x G Xk >n (z)" can be expressed also by a II3 
(and also a S3) formula because the relation S is a A^ relation. 

Now we have the following equivalences: 
C(F Tz )^Q<=>Bx [1 g C(F r J] ^ 3x [Vre>l 3k > 1 x G X fcn (*)] 
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Clearly the formula 3x [Vn > 1 3k > 1 x € Xfc.„(z)] is a S];-formula 
where there is a second order quantification 3x followed by an arithmetical 
rig-formula in which the quantifications Vn > 1 3k > 1 are first order 
quantifications on integers. □ 

End of Proof of Theorem 14.61 To prove the completeness part of the 
theorem we use some ideas of [CFS08' but we shall modify the constructions 
of [CFS08| in order to use the £}-completeness of the w-PCP(Reg) instead 
of the undecidability of the PCP. We are now going to reduce the w-PCP 
in a regular u;-language to the non-emptiness of the continuity set of an 
^-rational function. 

Let then/ = ({xi, . . . ,x n ), (y±, . . . ,y n ),A) bean instance of the w-PCP(Reg), 
where the X{ and yi are words over an alphabet V. We can construct an du- 
rational function F in the following way. 

Firstly, the domain Dom{F) will be a set of w-words over the alphabet 
{1, . . . , n} U {a, b}, where a and b are new letters not in {1, ... , n}. For x £ 
({1, . . . , n} U {a, b})^ we denote x(/{a, b}) the (finite or infinite) word over 
the alphabet {1, . . . , n} obtained from x when removing every occurrence of 
the letters a and b. And x(/{l, . . . , n}) is the (finite or infinite) word over 
the alphabet {a, 6} obtained from x when removing every occurrence of the 
letters 1, ... ,n. Then Dom(F) is the set of w-words x over the alphabet 
{1, . . . , n} U {a, b} such that x(/{a, b}) € L(A) (so in particular x(/{a, b}) 
is infinite) and x(/{l, . . . ,n}) is infinite. It is clear that this domain is a 
regular w-language. 

Secondly, for x E Dom(F) such that x(/{a, b}) = i\ii ■ ■ ■ ij. ■ ■ ■ G L(A) we 
set: 

• F(x) = x h x i2 ■■■x ik --- if x(/{l, ... ,n}) e ({a, &}* • a) w , and 

• F{x) = y h y l2 ■■■yi,--- if x(/{l, . . . , n}) € {a, 6}* • 6". 

The w-language ({a, 6}*.a) w is the set of w-words over the alphabet {a, b} 
having infinitely many letters a. The w-language {a, 6}*.6 W is the com- 
plement in {a,b} u of the w-language ({a,6}*.a) w : it is the set of w-words 
over the alphabet {a, b} containing only finitely many letters a. The two 
cj-languages ({a, 6}*.a) w and {a, 6}*.6 W are w-regular, and one can easily 
construct Biichi automata accepting them. Then it is easy to see that the 
function F is w-rational and that one can construct a Biichi transducer T ac- 
cepting the graph of the function F. Moreover one can construct an injective 
computable function ip : N — > N such that T = Tmj\ and so F = Fj ■ f . 
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We now prove that if x £ Dom(Fj, (I S) is a point of continuity of the function 
F r ^ (J) then the w-PCP(Reg) of instance I = ((x t , ... , x n ), (yi, ... , y n ),A) 
has a solution i\i2 ■ ■ ■ ik ■ ■ •, i-e. an w-word i\ii ■■■%}.■■■ € L(A) such that 

%il%i2 ' ' ' x ik = yiiUi2 ' ' ' Vik 

To simplify the notations we denote by -F the function Fj- - . We now 
distinguish two cases. 

First Case. Assume firstly that x(/{l, . . . , n}) £ ({a,b}* • a) w and that 
x(/{a,b}) = hi2---ik--- G L(A). Then by definition of F it holds that 
F(rc) = Xi t Xi 2 ■ ■ ■ Xi k ■ ■ ■. We denote z = x(/{l, . . . , n}). Notice that there 
is a sequence of elements z p € {a, b}* ■ W , p > 1, such that the sequence 
(•2p) p >i is convergent and lim(z p ) = z = x(/{l, . . . ,n}). This is due to the 
fact that {a, b}*.b w is dense in {a, b}^ . We call t p the infinite word over 
the alphabet {1, . . . , n} U {a, b} such that, for each integer i > 1, we have 
£p(i) = x(i) if x(i) G {1, . . . , n} and t p (i) = z p (k) if x(i) is the k th letter of z. 
Then the sequence (t p ) p >i is convergent and lim(t p ) = x. But by definition 
of F it holds that F(t p ) = yi Y y% 2 ■■■y% k --- for every integer p > 1 while 
i^rc) = Xi x Xi 2 ■ ■ ■ Xi k ■■■. Thus if x is a point of continuity of the function F 
then it holds that xi x xi 2 ■ ■ ■ xi k ■ ■ ■ = y^y^ ■ ■ ■ yt k ■ ■ ■ and the w-PCP(Reg) of 
instance / = ((xi, . . . ,x n ), (yi, . . . , y n ),A) has a solution i\i2 • • • ik • • •• 

Second Case. Assume now that x(/{l, . . . ,n}) G {a, 6}* • b^ and that 
x(/{a, b}) = i\ii ■■■ik- ■ ■ G L(A). Notice that ({a, 6}*.a) w is also dense in 
{a, b} u . Then reasoning as in the first case we can prove that if x is a point of 
continuity of F then xi x xi 2 ■ ■ ■ X{ k ■ ■ ■ = y%^y% 2 • • • yi k ■ ■ ■ and the u;-PCP(Reg) 
of instance I = ((xi, . . . , x n ), (yi, . . . ,y n ),A) has a solution i\ii •••%}•>••. 

Conversely assume that the w-PCP in a regular w-language of instance 
I = ((xi, . . . ,x n ), (yi, . . . ,y n ),A) has a solution i\i?, ■ ■ -if. ■ ■ -, i.e. an u»-word 
i\h •••ik--- 6 L(A) such that x h x i2 ■ ■ ■ Xi k ■ ■ ■ = y^y^ ■ ■ ■ yi k ■ ■ ■■ We now 
show that each x G Dom(F) such that x(/{a, b}) = i\%i ■ ■ ■ ik • • - is a point 
of continuity of the function F. Consider an infinite sequence (t p ) p >i of ele- 
ments of Dom(F) such that lim(t p ) = x. It is easy to see that the sequence 
(t p (/{a,b}))p>i is convergent and that its limit is the w-word x(/{a,b}) = 
i\i2 ■ ■ ■ ik " '■ This implies easily that the sequence F(t p ) p >i is convergent 
and that its limit is the cj-word F(x) = x^x^ ■ ■ ■ xi k ■ ■ ■ = yi x yi 2 ■ ■ ■ y% k ■ ■ ■■ 
Thus x is a point of continuity of F and this ends the proof. □ 

We consider now the continuity set of an w-rational function and its possible 
complexity. The following undecidability result was proved in [CFS08J. 
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Theorem 4.8 (see [CFS08]) One cannot decide whether the continuity 
set of a given uo-rational function f is a regular (respectively, context-free) 
uj -language. 

We can now give the exact complexity of the first above undecidable prob- 
lem. 

Theorem 4.9 It is U\-complete to determine whether the continuity set 
C(f) of a given oj-rational function f is a regular u-language. In other 
words the set {z G N | C(Fj- z ) is a regular co-language} is H\-complete. 

We first prove the following lemma. 

Lemma 4.10 The set {z G N | C{Fj- z ) is a regular uj -language} is in the 
class H\. 

Proof. Recall that A z denotes the Biichi automaton of index z. We can 
express the sentence u C(Ff z ) is a regular u;-language" by the sentence: 

3z' C(F T2 ) = L(A Z ,). 

On the other hand we have seen in the proof of Lemma 14.71 that 

x G C{F Tz ) <^> [Vn > 1 3k > 1 x G X k<n (z)] 

and then that x G C(Ff z ) can be expressed by an arithmetical rig-formula. 
We can now express C(Fj- z ) = L(A z i) by: 

Vx [(x G C{F Tz ) and x G L(A Z >)) or (x £ C{F % ) and x £ L(A Z ,))] 

which is a n} -formula because there is one universal second order quantifi- 
cation Vx followed by an arithmetical formula (recall that x G L{A z i) can 
be expressed by an arithmetical rig-formula). 

Finally the sentence 

3z' C(F Tz ) = L{A zl ) 

can be expressed by a Ilj-formula because the quantification 3z' is a first- 
order quantification bearing on integers and the formula C(Fj- z ) = L(A Z /) 
can be expressed by a Ilj-formula. □ 



End of Proof of Theorem 14.91 To prove the completeness part of the 
theorem we reduce the w-PCP in a regular w-language to the problem of the 
non-regularity of the continuity set of an w-rational function. 

As in the proof of the above Theorem l4.8l in [CFS08J, we shall use a particular 
instance of Post Correspondence Problem. For two letters c, d, let PCPi 
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be the Post Correspondence Problem of instance ((ii, £2)^3)7 (wi,W2, W3)), 
where t\ = c 2 , t 2 = £3 = d and wi = W2 = c, W3 = d 2 . It is easy to see that its 
solutions are the sequences of indices in {l*-2*-3* | i > 1}U{3 4 -2 J -P | i > 1}. 
In particular, this language over the alphabet {1, 2, 3} is not context-free and 
this will be useful in the sequel. 

Let then/ = ((xi, . . . , x n ), (yi, . . . ,y n ),A) be an instance of the w-PCP(Reg), 
where the Xj and yi are words over an alphabet l~. We can construct an u- 
rational function F' in the following way. 

Let D = {di,d 2 , d%} such that D and {1, . . . , n} U {a, b} are disjoint. The 
domain Dom(F') will be a set of u- words in D + ■ Dom(F), where, as in the 
proof of Theorem 14.61 Dom(F) is the set of w-words x over the alphabet 
{1, . . . , n} U {a, b} such that x(/{a, b}) € L(A) (so in particular x(/{a, b}) is 
infinite) and x(/{l, . . . , n}) is infinite. It is clear that the domain Dom(F') 
is a regular w-language. 

Now, for x £ Dom(F') such that x = dj 1 - ■ ■ dj p ■ y with y € Dom(F) and 
y{/{a, b}) = iii 2 •••«*•••■ G i(»4) we set: 

• F'(x) = t h ■■■t jp x il x i2 ■■■x ik ■■■ ify(/{l,...,n})<E({a,b}*-a) w , 
and 

• F'(x) = w h ■ ■ ■ w jp y h y i2 ■■■y ih --- if y(/{l, ...,n})€ {a, b}* ■ b w . 

Then it is easy to see that the function F' is w-rational and that one can 
construct a Biichi transducer T' accepting the graph of the function F' . 
Moreover one can construct an injective computable function O : N — > N 
such that T' = Tqij\ and so F' = Fj- Q T . 

Reasoning as in the preceding proof we can prove that the function F' is 
continuous at point x = dj x - ■ ■ dj p ■ y, where y £ Dom(F) , if and only if the 
the sequence ji, ■ ■ ■ ,j p is a solution of the Post Correspondence Problem 
PCPi and y(/{a,b}) = ^l^2•••^/^••• is a solution of the w-PCP(Reg) of 
instance I = ((x 1} . . . ,x n ), (y 1} . . . ,y n ),A). 

Thus if the w-PCP(Reg) of instance I = ((xi, • • • , x n ), (yi, . . . , y n ),A) has 
no solution, then the continuity set C(F') is empty, hence it is w-regular. 

On the other hand assume that thecj-PCP(Reg) of instance/ = ((xi, . . . ,x n ), 
(yi, ... , y n ), A) has some solutions. In that case the continuity set C(F') is 
in the form T ■ R where T = {d[ ■d 2 -d\\i>l}U {d\ ■ d 2 ■ d{ \i > 1} and R is 
a set of infinite words over the alphabet {1, . . . , n} U {a, b}. In that case the 
continuity set C(F") can not be w-regular because otherwise the language T 



17 



should be regular (since D = {d\, cfe, d%} and {1, . . . , n} U {a, b} are disjoint) 
and it is not even context-free. 

This shows that thew-PCP(Reg) of instance I = ((xi, . . . ,x n ), (y\, . . . ,y n ),A) 
has a solution if and only if the continuity set C(F') is not w-regular. This 
ends the proof. □ 

It is natural to ask whether the set {z G N | C(Ff z ) is a context-free u>- 
language} is also IlJ-complete. But one cannot extend directly Lemma [4.1Ui 
replacing regular by context-free. If we replace the Biichi automaton A z of 
index z by the Biichi pushdown automaton B z of index z, we get only that 
the set {z E N | C(Fj- z ) is a context-free w-language} is in the class n^ 
because the "x € L(B Z /)" can only be expressed by a £}-formula. On the 
other hand, the second part of the proof of Theorem 14.91 proves in the same 
way that the set {z € N | C(Fj-J is a context-free w-language} is l~l}-hard. 
Thus we can now state the following result. 

Theorem 4.11 The set {z G N | C(Fj- z ) is a context-free co-language} is 
H\-hard and in the class Big \ £*. 

5 Concluding remarks 

We have given a complete proof of the Ej-completeness of the w-PCP in 
a regular ^-language, also denoted w-PCP(Reg). Then we have applied 
this result and obtained the exact complexity of several highly undecidable 
problems about infinitary rational relations and w-rational functions. In par- 
ticular, we have showed that there is an amazing gap between two decision 
problems about w-rational functions realized by finite state Biichi transduc- 
ers: it is decidable whether a given w-rational function is continuous, while 
it is S|-complete to determine whether a given w-rational function has at 
least one point of continuity. 

We hope that this paper will attract the reader's attention on a new highly 
undecidable problem, the w-PCP(Reg), which could be very useful to study 
the frontiers between decidable and undecidable problems. 
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